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(57) Abstract: Apparatus for and method 
of fully automatic rapid scanning and 
digitizing of an entire microscope sample 
using a computer controlled microscope 
slide scanner for composing the image 
strips obtained from successive scans of 
the sample into a single contiguous digital 
image. The method provides for statically 
displaying sub-regions of this large digital 
image at different magnifications, together 
with, a reduced magnification macro-image 
of the entire sample. The method also 
provides for dynamically displaying portions 
of the contiguous digital image. In one 
preferred embodiment all elements of 
the scanner are in single-enclosure with 
a primary connection to the Internet or 
to a local intranet In this embodiment, 
the preferred sample type is a microscope 
slide with illumination and imaging optics 
consistent with transmission mode optics for 
diffraction-limited digital imaging. 
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FULLY AUTOMATIC RAPID MICROSCOPE SLIDE SCANNER 

TECHNICAL FIELD 

The present invention r^ljates generally to the field of optical microscopy and 

5 pertains more specifically to a fiilly automatic rapid microscope slide scanner. 

BACKGROUND ART 

One of the inherent limitations Of optical microscopy is the tradeoff between the 

field of view, the portion of the sample that can be viewed through the eyepieces of a 

10 microscope, and the magnification afwhich the sample can be viewed. While higher 

magnification microscope objective lenses with higher numerical apertures (NA) 

provide the microscopist with an enlarged and often higher resolution image, the field of 

view decreases dramatically with increases in magnification, in proportion to the square 

of the magnification. Even at very low magnifications such as 1 .25 times (1.25x), only 

15 a small area of a typical microscope slide can be viewed through the binoculars of a 

conventional microscope. The field of view limitation of optical microscopy requires 

that the microscopist manually scan a slide at low magnification to obtain an overall 

view of the sample or specimen. When an area of interest appears in one of the lower 

magnification fields of view, the microscopist manually selects a higher magnification 

20 objective lens to obtain an enlarged higher resolution view of a proportionately smaller 

area of the specimen. For samples such as histological specimens that are viewed by a 

pathologist, it is typical for the pathologist to frequently switch back and forth between 

a lower magnification objective lens with a larger field of view, for purposes of 

orienting himself or herself with respect to the specimen, and one or more higher 
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magnification, smaller field of view objective lenses for purposes of viewing the sample 
in greater detail. 

One approach to overcome the optical microscopy limitation of simultaneously 
achieving both a large field of view, and high magnification, is to capture multiple 
5 individual digital images from contiguous fields of view, thereby creating a large field 
of view image. A scanning system is used to move the sample, while a rectangular 
optical sensor such as an area scan charge-coupled device (CCD) camera captures an 
image of each field of view at the desired magnification. The process of assembling 
these smaller fields of view (hereinafter "image tiles' 1 ) into one coherent image is called 
10 image tiling. Early image tiling systems, such as the system discussed in U.S. Patent 
No. 4,760,385 (Jannson et al.) were based on creating a contiguous high resolution tiled 
image from approximately thirty-six individual video frame image tiles captured in a 

region of the sample that was previously and interactively selected by an operator. 

t 

Similar but more sophisticated image tiling system have more recently become 
15 available. One such system is sold by Bacus Laboratories, Inc., Downers Grove, IL., 
under the name Bacus Laboratories Inc., Slide Scanner (hereinafter "BLISS"). Elements 
of the BLISS system are described in Patent Cooperation Treaty publications WO 
98/39728 and WO 98/44446. 

The BLISS system is designed primarily for the anatomic pathologist who has a 
20 need to combine the anatomic orientation of a histological specimen that is obtained at 
very low magnification, together with several high magnification views of areas of the 
specimen that have been interactively selected by the pathologist from the low 
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magnification tiled image, also referred to as a macro image. The BLISS system 
enables the pathologist to quickly flip back and forth between selected high resolution 
micro images of selected areas captured at 20x or 40x, and a low resolution macro 
image captured at 1 .25x, emulating in some sense the pathologist's manual use of a 
5 conventional microscope. Alternatively, the BLISS system user interface provides 
separate split screens on a display monitor whereby the pathologist is shown an overall 
macro view and a marker showing where the current higher magnification view is 
located. A tiled image is constructed by assembling several adjacent, original 
microscope views at a first magnification to obtain an overall macro view of the 
10 . specimen, together with several adjacent original microscope views at a higher 

magnification to create a combined data structure. The data structure is obtained by 

/ ■ ■ 

digitally scanning and storing the low magnification image tiles with their mapping 
coordinates and likewise, digitally scanning and storing higher magnification image tiles 
with their mapping coordinates. Furthermore, a pathologist may interactively select f 

1 5 only those diagnostically significant areas of the specimen for digital scanning and 

storing to reduce significantly the number of image pixels stored at high resolution. The 
data structure, akin to a virtual microscopie slide, may then be transferred to a remote 
viewer over a network such as the Internet. The remote user is thus provided with a 
series of abutted, tiled images, with each image tile being substantially equal to one 

20 small optical field of view at each of two different optical magnifications. 

The BLISS system is integrated around a computer-controlled, automated 
microscope such as the Axioplan-2 microscope system sold by Carl Zeiss, Inc., 
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Thornwood, NY. This type of high-end microscope has capabilities for computer- 
control of several subsystems, including the illumination subsystem, the focusing 
subsystem, the microscope objective lens subsystem, the filtering subsystem, as well as 
multiple field and condenser diaphragms or optical stops which may be used to achieve 
5 optimum Koehler illumination. Essentially, all moveable elements of the microscope 
can be controlled from the computer; and in principle, from a remote location via the 
Internet. Positions for all diaphragms and other settings such as focus and illumination 
level are stored by the computer, enabling microscope objective lenses to be changed 
without manual intervention. The BLISS system is also equipped with a computer 

1 0 controlled two-axis (x/y for left/right/up/down motion) translation stage that achieves 
0.1 micrometer positioning accuracy using position encoders and closed-loop feedback 
control to provide superior positioning performance. A CCD camera with 752 by 480 
pixels, and an image frame grabber are also integrated into the BLISS system. 

Because it is based on image tiling, the BLISS system suffers from several 

1 5 known disadvantages of the image tiling approach. For example, a first disadvantage of 
the BLISS system is that it takes a long time, typically twenty minutes or longer to 
acquire the tiled data structures. These time estimates are without consideration for any 
additional delays that may be incurred during manual intervention, for example, prior to 
acquiring high magnification tiled images from selected areas of the low magnification 

20 macro image. Tiling involves moving a slide on a motorized stage, in discrete steps 
equal to the width of a single field of view, and with respect to a stationary area scan 
camera such as the CCD camera used by the BLISS system. An image tile is acquired 



WO 01/84209 



-5- 



PCT/US01/08028 



at every step. Individual images are then tiled together to create a larger seamless image 
of the area of interest. Image tiling is relatively slow because of the need to minimize 
any significant relative motion between the sample and the camera while the image is 
captured. A major cause of relative motion is the settling time of the mechanical 
5 positioning stage after issuing sequential stop and go commands. To acquire images 
without unacceptable smearing requires waiting until the stage has settled, ideally to 
within less than one pixel. For example, at a 40x magnification, the width of a single 
image tile captured by a one-half inch format CCD camera corresponds to 160 
micrometers of the sample. At this magnification, each individual pixel in a 752-pixel 

1 0 wide CCD camera subtends approximately 0.2 micrometers of the sample. A single 
tiling step thus requires a relatively large 1 60 micrometer movement, with associated 
acceleration and deceleration of the mechanical stage. In order to avoid any smearing of 
the image, the image tile should be captured only after the mechanical stage has settled 
to less than one pixel, or about 0.2 micrometers, of motion. U.S. Patent No. 5,912,699 

15 (Hayenga et al.) addresses this well known settling time limitation of conventional 

image tiling systems by proposing an alternate method that combines image tiling using 
conventional area scan cameras with strobe light synchronization. The slow capture 
times of tiling systems, including the BLISS system, limits the practical utility of image 
tiling to a two-step process, with extensive manual intervention between the capture of 

20 an initial very low magnification macro image and the subsequent selection of small 
areas for higher magnification capture. 

The slow acquisition time associated with tiling systems leads to a second 
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disadvantage of the BLISS system, that being the need for manual intervention during 
the process of creating the tiled data structure. After pre-scanning a slide at a very low 
microscope objective lens magnification of 1 .25x, the BLISS operator inspects the 
macro-image for relevant regions of interest to be scanned using a higher magnification 
5 objective lens. While one motivation for the manual intervention may be to limit the 
size of the final data structure, manual intervention is absolutely essential to define 
smaller areas which can be acquired in a reasonable time. For example, it would not be 
practical, because of acquisition time considerations, to use the BLISS system to scan an 
entire microscope slide at 20x magnification. At a 20x magnification, approximately 

1 0 1 6,300 individual image tiles must be captured to digitize a two inch by one inch area of 
a microscope slide using a 752 by 480 pixel one-half inch format area scan CCD. 
Assuming further that it takes approximately one second to acquire each image tile, due 
in large part to the relatively long mechanical settling times associated with each of the 
16,300 repeated stop-and-go commands, the total acquisition time would be four and 

1 5 one-half hours. At a 40x magnification, the acquisition time would quadruple to 
eighteen hours. Even at a lOx magnification the acquisition time would exceed one 
hour. However, at the BLISS system's very low magnification of 1 .25x, only 64 image 
tiles are needed to create a macro-image of a two inch by one inch area of a microscope 
slide. The total acquisition time for such a macro-image is about one minute. 

20 Understanding now that the acquisition time limitations of any image tiling 

system require the capture of a very low magnification macro-image, followed by the 
interactive selection from this macro image of small areas to be captured at higher 
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magnification, a third disadvantage of the BLISS system becomes apparent. This third 
disadvantage resides in the realization that locating areas of interest from a very low 
magnification macro-image is practically limited to samples in which anatomic 
reference information is available. The BLISS system thus has limited utility for non- 
5 histological samples such as Pap smears, because such cytological samples inherently 
lack any information about anatomic orientation. In such samples the cells are more or 
less randomly distributed over a large area of the microscope slide. Without the ability 
to define, using the macro image, the specific smaller regions of interest that are to be 
tiled at higher optical magnifications, the only alternative is to scan and digitize the 

10 entire sample. However, as described previously, the long acquisition times required by 
the image tiling method make this alternative virtually impractical. Stated differently, 
without manual intervention to define specific and significantly smaller areas of the 
microscope slide for image tiling at higher magnifications, an impossibility for 
cytological samples, a tiling approach has limited utility. One would prefer a system for 

1 5 scanning microscope slides which is fully automatic, without the need for manual 

intervention. Such a system would also be suitable for all types of microscope slides, 
regardless of whether or not the slide contains anatomic reference information. 

A fourth disadvantage of the BLISS system is its complexity and expense. The 
BLISS system is based largely on off-the-shelf components, including a high-end, fully 

20 automated third-party microscope with multiple objective lenses and an expensive 

closed xly stage control loop. The suggested end-user price of the BLISS system is well 
above $100,000. The multiple automated elements of the BLISS system represent a 
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complicated system that, in spite of its extensive automation, may be difficult to operate 
and maintain. One would prefer a system for scanning microscope slides which is 
simple and reliable, and which can be made available for about one third of the cost of 
the BLISS system. 

5 Inherent in the cost disadvantage of the BLISS system are several limitations of 

any microscope slide scanning system that is based on a conventional microscope, The 
most expensive component of the BLISS system is the automated microscope itself. 
One of the reasons for incorporating a fully automatic microscope into the BLISS 
system is the need for automatically changing many settingswhen the microscope 

0 . objective lens turret is rotated automatically to change microscope objective lenses, for 
example, from 1.25x to 40x. A typical microscope, upon changing the microscope 

objective lens, will have a different optimal plane of focus and require new settings for 

/ 

the field and condenser diaphragms to achieve Koehler illumination. Also, a different 
intensity of illumination will be needed to optimally fill the dynamic range of the CCD. 

5 The need for such extensive automation is eliminated if the requirement for changing 
microscope objective lenses can be eliminated. One would prefer a rapid scanning 
method that can not only overcome the field of view limitations of traditional optical 
microscopy but that can also eliminate the need for multiple microscope objective 
lenses, providing a substantial cost advantage over image tiling systems such as BLISS. 

0 The need for a single microscope objective lens is also closely related to eliminating the 
constraints imposed by the optics of a conventional microscope. One would prefer a 
system based on an optical design that ensures that microscope slides are scanned and 
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digitized at diffraction-limited resolutions, that is, all possible spatial details available at 
the resolution of the microscope objective lens are captured by the digital image. Once 
a diffraction-limited digital image has been captured, degenerate lower resolution and 
magnification images can be created using standard computational algorithms. 
5 In many microscopy applications it is necessary that the entire sample, or a large 

portion of a sample, be searched for defects or for the presence or absence of a special 
object or objects, for example, abnormal cells. Microscopy becomes very labor 
intensive when large portions of a sample, or even the entire sample, must be manually 
scanned at low resolutions, typically lOx to 20x, in order to identify specific areas of 

1 0 interest for subsequent higher resolution interrogation. Extended manual screening or 
continued viewing of a single field causes eyestrain, fatigue, and visual habituation that 
can negatively affect productivity and accuracy. The problem of rapidly finding and 
locating relevant areas of interest for subsequent higher resolution interrogation has 
been addressed using conventional real-time scanning systems that combine 

1 5 microscopes with ancillary linear array detectors and automated positioning tables, all 
controlled by a computer. Some approaches, such as the system discussed in U.S. 
Patent No. 5,922,282 (Ledley et ah)," are based on storing the x/y stage coordinates of 
relevant objects found on regions of the physical slide to enable relocation of the object, 
in this case mycobacteria on a customized glass microscope slide. The x/y coordinates 

20 of the mycobacteria are obtained using specialized real-time pattern recognition 

circuitry that is applied to the intensity information measured by a line scan camera that 
is synchronized to a stage which is moved in relatively large five micrometer steps. 
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Alternatively, an area scan sensor such as a video camera can be used as the basis for 
deriving the xly coordinates of selected objects, in conjunction with similar circuitry. In 
this latter case, the stage is moved in larger steps corresponding to a complete image 
field, similar to the stage movements required by the tiling method. Focus is maintained 
5 using instantaneous automated focus control. An alternate system described in U.S. 
Patent No. 4,700,298 (Palcic et al.) uses a linear array CCD attached to a commercially 
available microscope, with means for autofocus, to scan large areas for purposes of 
recording, in real time, the xly coordinates of cells growing in a tissue flask. These 
known methods and systems are all based on the real-time analysis of digital 

10 information that is acquired and processed during the scanning process. ? In many cases, 
specialized circuitry is used to immediately process the intensity data that has been read 
out from the linear array detector, enabling a decision to be made in real-time. An 
alternative novel approach is to use a linear array sensor to rapidly assemble a large 
contiguous image of the entire microscope slide at optical resolutions sufficient for 

1 5 automating the labor intensive aspects of manual slide scanning. One would prefer a 
system that can be used, together with digital image processing methods, as an 
alternative to manual slide scanning. j 

Another common problem associated with manual scanning of microscope slides 
is that portions of a slide are easily missed during manual xly scanning of a slide. 

20 Relocation to previously identified cells can be difficult, especially after the slide has 
been removed from the microscope. The problem of not missing any areas of a slide 
during manual xly scanning has been addressed by position encoding quality assurance 
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systems that record the xly position and dwell time of areas of the physical slide that 
have been examined manually, thus highlighting areas of the slide that were missed or 
possibly viewed too quickly. U.S. Patent No. 5,793,969 (Kamentsky et al.) discusses a 
method for quality assurance of a Pap smear slide that has been previously reviewed by 
5 a technologist. This method is based on recording the xly stage coordinates of all fields 
visited by the technologist during the slide review, and creating an xly map of relative 
slide dwell times. 

A definite need exists for a simple and reliable system that can rapidly scan and 
digitize an entire microscope slide. The scanning and digitization should be performed 

10 at optical resolutions comparable to those used for the manual scanning of microscope 
slides, thereby enabling the application of image processing algorithms to the digital 
imagery data set, in lieu of, or in addition to, manually scanning an entire slide. Ideally, 
such a system should not require any type of manual intervention during the image 
acquisition process. Such a system should also be suitable for all types of microscope 

1 5 specimens, regardless of whether or not the slide contains anatomic reference 

information. Ideally, such a system should have a lower cost than conventional systems. 
Such a system should also not be constrained by the limitations and inherent cost of 
conventional off-the-shelf microscopes, enabling an optical design that allows the 
capture of diffraction-limited digital images. A primary purpose of the present 

20 invention is to solve these needs and to provide further, related advantages. 



DISCLOSURE OF INVENTION 

The present invention provides an apparatus for and a method of fully automatic 
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rapid scanning and digitizing of an entire microscope sample, or a substantially large 
portion of a microscope sample, using a linear array detector synchronized with a 
positioning stage that is part of a computer controlled microscope slide scanner. The 
invention also provides a method for composing the image strips obtained from 
5 successive scans of the sample into a single contiguous digital image. The invention 
further provides a method for statically displaying sub-regions of this large digital image 
at different magnifications, together with a reduced magnification macro image of the 
entire sample. The invention also provides a method for dynamically displaying, with 
or without operator interaction, portions of the contiguous digital image. In one 
1 0 preferred embodiment of the invention, all elements of the scanner are part of a single- 
enclosure that has a primary connection to a network such as the Internet or a local' 
intranet. In this embodiment, the preferred sample type is a microscope slide and the 
illumination and imaging optics are consistent with transmission mode optics optimized 
for diffraction-limited digital imaging. 

15 

BRIEF DESCRIPTION OF DRAWING 

The objects, advantages and features of this invention will be more readily 
appreciated from the following detailed description, when read in conjunction with the 
accompanying drawing, in which: 
20 J FIG. 1 is a block diagram of a preferred embodiment of an optical microscopy . 

system according to the present invention; 

FIG. 2 is a block diagram of a second embodiment of an optical microscopy 

system according to the present invention; 
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FIGS. 3A-3C illustrates a manner in which contiguous image strips acquired by 
a linear array detector digitizes a portion of a sample according to the present invention: 

FIG. 4 is a simplified flow chart of the operation of an optical microscopy 
system according to the present invention; 
5 FIGS. 5A-5B are a schematic diagram of an image viewing frame according to 

the present invention; and 

FIGS. 6A-6B are a schematic diagram of a dynamic image viewing frame 
according to the present invention. 

10 BEST MODE FOR CARRYING OUT THE INVENTION 

^ Turning first to FIG. 1, a block diagram of a preferred embodiment of an optical 

microscopy system 10 according to the present invention is shown. The heart of the 

system 10 is a microscope slide scanner 1 1 that serves to scan and digitize a specimen or 

sample 12. The sample 12 can be anything that may be interrogated by optical 

1 5 microscopy. For instance, the sample 12 may be a microscope slide or other sample 
type that may be interrogated by optical microscopy. A microscope slide is frequently 
used as a viewing substrate for specimens that include tissues and cells, chromosomes, 
DNA, protein, blood, bone marrow, urine, bacteria, beads, biopsy materials, or any other 
type of biological material or substance that is either dead or alive, stained or unstained. 

20 labeled or unlabeled. The sample 12 may also be an array of any type of DNA or DNA- 
related material such as cDNA or RNA or protein that is deposited on any type of slide 
or other substrate, including any and all samples commonly known as a microarrays. 
The sample 12 may be a microtiter plate, for example a 96-well plate. Other examples 



WO 01/84209 PCT/US01/08028 

.14. 

of the sample 12 include integrated circuit boards, electrophoresis records, petri dishes, 
film, semiconductor materials, forensic materials, or machined parts. 

The scanner 1 1 includes a motorized stage 14, a microscope objective lens 16, a 
line scan camera 1 8, and a data processor 20. The sample 12 is positioned on the 
5 motorized stage 14 for scanning. The motorized stage 14 is connected to a stage 

controller 22 which is connected in turn to the data processor 20. The data processor 20 
determines the position of the sample 12 on die motorized stage 14 via the stage 
controller 22. In the presently preferred embodiment, the motorized stage 14 moves the 
sample 12 in at least the two axes (xiy) that are in the plane of the sample 12. Fine 

10 movements of the sample 12 along the optical z-axis may also be necessary for certain 
applications of the scanner 1 1, for example, for focus control. Z-axis movement is 
preferably accomplished with a piezo positioner 24, such as the PIFOC from Polytec PI 
or the MIPOS 3 from Piezosystem Jena. The piezo positioner 24 is attached directly to 
the microscope objective 16 and is connected to and directed by the data processor 20 

15 via a piezo controller 26. A means of providing a coarse focus adjustment may also be 
needed and can be provided by z-axis movement as part of the motorized stage 14 or a 
manual rack-and-pinion coarse focus adjustment (not shown). 

In the presently preferred embodiment, the motorized stage 14 includes a high 
precision positioning table with ball bearing linear ways to provide smooth motion and 

20 excellent straight line and flatness accuracy. For example, the motorized stage 14 could 
include two Daedal model 106004 tables stacked one on top of the other. Other types of 
motorized stages 14 are also suitable for the scanner 1 1 , including stacked single axis 
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stages based on ways other than ball bearings, single- or multiple-axis positioning stages 
that are open in the center and are particularly suitable for trans-illumination from below . 
the sample, or larger stages that can support a plurality of samples. In the presently 
preferred embodiment, motorized stage 14 includes two stacked single-axis positioning 
5 tables, each coupled to two millimeter lead-screws and Nema-23 stepping motors. At 
the maximum lead screw speed of twenty-five revolutions per second, the maximum 
speed of the sample 12 on the motorized stage 14 is fifty millimeters per second. 
Selection of a lead screw with larger diameter, for example five millimeters, can 
increase the maximum speed to more than 100 millimeters per second. The motorized 
10 stage 14 can be equipped with mechanical or optical position encoders which has the 
disadvantage of adding significant expense to the system. Consequently, the presently 
preferred embodiment does not include position encoders. However, if one were to use 
servo motors in place of stepping motors, then one would have to use position feedback 
for proper control. 

1 5 Position commands from the data processor 20 are converted to motor current or 

voltage commands in the stage controller 22. In the presently preferred embodiment, 
the stage controller 22 includes a 2-axis servo/stepper motor controller (Compumotor 
6K2) and two 4-amp microstepping drives (Compumotor OEMZL4). Microstepping 
provides a means for commanding the stepper motor in much smaller increments than 

20 the relatively large single 1 .8 degree motor step. For example, at a microstep of 1 00, the 
sample 12 can be commanded to move at steps as small as 0.1 micrometer. A microstep 
of 25,000 is used in the presently preferred embodiment of this invention. Smaller step 
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sizes are also possible. It should be obvious that the optimum selection of the motorized 
stage 14 and the stage controller 22 depends on many factors, including the nature of the 
sample 12, the desired time for sample digitization, and the desired resolution of the 
resulting digital image of the sample 12. 
5 The microscope objective lens 16 can be any microscope objective lens 

commonly available. One of ordinary skill in the art will realize that the choice of 
which objective lens to use will depend on the particular circumstances. In the preferred 
embodiment of the present invention, the microscope objective lens 16 is of the infinity- 
corrected type. 

10 The sample 1 2 is illuminated by an illumination system 28 that includes a light 

source 30 and illumination optics 32. The light source 30 in the presently preferred 
embodiment includes a variable intensity halogen light source with a concave reflective 
mirror to maximize light output and a KG-1 filter to suppress heat. However, the light 
source 30 could also be any other type of arc-lamp, laser, or other source of light. The 

15 illumination optics 32 in the presently preferred embodiment include a standard Kohler 
illumination system with two conjugate planes that are orthogonal to the optical axis. 

i 

The illumination optics 32 are representative of the bright-field illumination optics that 
can be found on most commercially available compound microscopes sold by 
companies such as Carl Zeiss, Nikon, Olympus, or Leica. One set of conjugate planes 
20 includes (i) a field iris aperture illuminated by the light source 30, (ii) the object plane 
that is defined by the focal plane of the sample 12, and (iii) the plane containing the 
light-responsive elements of the line scan camera 1 8. A second conjugate plane 
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includes (i) the filament of the bulb that is part of the light source 30, (ii) the aperture of 
a condenser iris that sits immediately before the condenser optics that are part of the 
illumination optics 32, and (iii) the back focal plane of the microscope objective lens 16. 
In the presently preferred embodiment, the sample 12 is illuminated and imaged in 
5 transmission mode, with the line scan camera 1 8 sensing optical energy that is 
transmitted by the sample 12, or conversely, optical energy that is absorbed by the 
sample 12. 

f 

The scanner 1 1 of the present invention is equally suitable for detecting optical 
energy that is reflected from the sample 12, in which case the light source 30, the 

10 illumination optics 32, and the microscope objective lens 16 must be selected based on 
compatibility with reflection imaging. One possible embodiment may therefore be 
illumination through a fiber optic bundle that is positioned above the sample 12. Other 
possibilities include excitation that is spectrally conditioned by a monochromator. If the 
microscope objective lens 16 is selected to be compatible with phase-contrast 

15 microscopy, then the incorporation of at least one phase stop in the condenser optics that 
are part of the illumination optics 32 will enable the scanner 1 1 to be used for phase 
contrast microscopy. To one of ordinary skill in the art, the modifications required for 
other types of microscopy such as differential interference contrast and confocal 
microscopy should be readily apparent. Overall, the scanner 1 1 is suitable, with 

20 appropriate but well-known modifications, for the interrogation of microscopic samples 
in any known mode of optical microscopy. 

Between the microscope objective lens 16 and the line scan camera 18 are 
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situated the line scan camera focusing optics 34 that focus the optical signal captured by 
the microscope objective lens 16 onto the light-responsive elements of the line scan 
camera 18. In a modern infinity-corrected microscope the focusing optics between the 
microscope objective lens and the eyepiece optics, or between the microscope objective 

J 

5 lens and an external imaging port, consist of an optical element known as a tube lens 
that is part of a microscope's observation tube. Many times the tube lens consists of 
multiple optical elements to prevent the introduction of coma or astigmatism. One of 
the motivations for the relatively recent change from traditional finite tube length optics 
to infinity corrected optics was to increase the physical space in which the optical 

10 . energy from the sample 12 is parallel, meaning that the focal point of this optical energy 
is at infinity. In this case, accessory elements like dichroic mirrors or filters can be 
inserted into the infinity space without changing the optical path magnification or 
introducing undesirable optical artifacts. 

Infinity-corrected microscope objective lenses are typically inscribed with an 

1 5 infinity mark. The magnification of an infinity corrected microscope objective lens is 
given by the quotient of the focal length of the tube lens divided by the focal length of 
the objective lens. For (example, a tube lens with a focal length of 1 80 millimeters will 
result in 20x magnification if an objective lens with 9 millimeter focal length is used. 
One of the reasons that the objective lenses manufactured by different microscope 

20 . manufacturers are not compatible is because of a lack of standardization in the tube lens 
focal length. For example, a 20x objective lens from Olympus, a company that uses a 
1 80 millimeter tube lens focal length, will not provide a 20x magnification on a Nikon 
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microscope that is based on a different tube length focal length of 200 millimeters. 
Instead, the effective magnification of such an Olympus objective lens engraved with 
20x and having a 9 millimeter focal length will be 22.2x, obtained by dividing the 200 
millimeter tube lens focal length by the 9 millimeter focal length of the objective lens. 
5 Changing the tube lens on a conventional microscope is virtually impossible without 
disassembling the microscope. The tube lens is part of a critical fixed element of the 
microscope. Another contributing factor to the incompatibility between the objective 
lenses and microscopes manufactured by different manufacturers is the design of the 
' eyepiece optics, the binoculars through which the specimen is observed. While most of 

10 the optical corrections have been designed into the microscope objective lens, most 
microscope users remain convinced that there is some benefit'in matching one 
manufacturers' binocular optics with that same manufacturers' microscope objective 
lenses to achieve the best visual image. 

The line scan camera focusing optics 34 include a tube lens optic mounted inside 

15 of a mechanical tube. Since the scanner 1 1 , in its preferred embodiment, lacks 
binoculars or eyepieces for traditional visual observation, the problem suffered by 
conventional microscopes of potential incompatibility between objective lenses and 
binoculars is immediately eliminated. One of ordinary skill will similarly realize that 
the problem of achieving parfocality between the eyepieces of the microscope and a 

20 digital image on a display monitor is also eliminated by virtue of not having any 
eyepieces. Since the scanner 1 1 also overcomes the field of view limitation of a 
traditional microscope by providing a field of view that is practically limited only by the 
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physical boundaries of the sample 12, the importance of magnification in an all-digital 
imaging microscope such as provided by the present scanner 1 1 is limited. Once a 
portion of the sample 12 has been digitized, it is straightforward to apply electronic 
magnification, sometimes known as electric zoom, to an image of the sample 12 in order 
5 to increase its magnification. Increasing the magnification of an image electronically 
has the effect of increasing the size of that image on the monitor that is used to display 
the image. If too much electronic zoom is applied, then the display monitor will be able 
to show only portions of the magnified image. It is not possible, however, to use 
electronic magnification to display information that was not present in the original 

1 0 optical signal that was digitized in the first place. Since one of the objectives of the 
scanner 1.1 is to provide high quality digital images, in lieu of visual observation 
through the eyepieces of a microscope, it is important that the content of the images 
acquired by the scanner 1 1 include as much image detail as possible. The term 
resolution is typically used to describe such image detail and the term diffraction-limited 

15 is used to describe the wavelength-limited maximum spatial detail available in an 

optical signal. The scanner 1 1 provides diffraction- limited digital imaging by selection 
of a tube lens focal length that is matched according to the well know Nyquist sampling 
criteria to both the size of an individual pixel element in a light-sensing camera such as 
the line scan camera 1 8 and to the numerical aperture of the microscope objective lens 

20 16. It is well known that numerical aperture, not magnification, is the resolution- 
limiting attribute of a microscope objective lens 16. 

An example will help to illustrate the optimum selection of a tube lens focal 
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length that is pan of the line scan camera focusing optics 34. Consider again the 20x 
microscope objective lens 16 with 9 millimeter focal length discussed previously and 
assume that this objective lens has a numerical aperture of 0.50. Assuming no 
appreciable degradation from the condenser, the diffraction-limited resolving power of 
5 this objective lens at a wavelength of 500 nanometers is approximately 0.6 micrometers, 
obtained using the well-known Abbe relationship. Assume further that the line scan 
camera 1 8, which in its preferred embodiment has a plurality of 14 micrometer square 
pixels, is used to detect a portion of the sample 12. In accordance with sampling theory, 
it is necessary that at least two sensor pixels subtend the smallest resolvable spatial 

10 feature. In this case, the tube lens must be selected to achieve a magnification of 46.7 ; 
obtained by dividing 28 micrometers, which corresponds to two 14 micrometer pixels, 
by 0.6 micrometers, the smallest resolvable feature dimension. The optimum tube lens 
optic focal length is therefore about 420 millimeters, obtained by multiplying 46.7 by 9. 
The line scan focusing optics 34 with a tube lens optic having a focal length of 420 

1 5 millimeters will therefore be capable of acquiring images with the best possible spatial 
resolution, similar to what would be observed by viewing a specimen under a 
microscope using the same 20x objective lens. To reiterate, the scanner 1 1 utilizes a 
traditional 20x microscope objective lens 16 in a higher magnification optical 
configuration, in this example about 47x, in order to acquire diffraction-limited digital 

20 images. If a traditional 20x magnification objective lens 16 with a higher numerical 
aperture were used, say 0.75, the required tube lens optic magnification for diffraction- 
limited imaging would be about 615 millimeters, corresponding to an overall optical 
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magnification of 68x. Similarly, if the numerical aperture of the 20x objective lens were 

only 0.3, the optimum tube lens optic magnification would only be about 28x, which 

r 

corresponds, to a tube lens optic focal length of approximately 252 millimeters. The line 
scan camera focusing optics 34 are modular elements of the scanner 1 1 and can be 
5 interchanged as necessary for optimum digital imaging. The advantage of diffraction- 
limited digital imaging is particularly significant for applications, for example bright 
field microscopy, in which the reduction in signal brightness that accompanies increases 
in magnification is readily compensated by increasing the intensity of an appropriately 
designed illumination system 28. 

1 0 In principle, it is possible to attach external magnification-increasing optics to a 

conventional microscope-based digital imaging system to effectively increase the tube 
lens magnification so as to achieve diffraction-limited imaging as has just been 
described for the present scanner 1 1; however, the resulting decrease in the field of view 
is often unacceptable, making this approach impractical. Furthermore, many users of 

1 5 microscopes typically do not understand enough about the details of diffraction-limited 
imaging to effectively employ these techniques on their own. In practice, digital 
cameras are attached to microscope ports with magnification-decreasing optical couplers 
to attempt to increase the size of the field of view to something more similar to what can 
be seen through the eyepiece. The standard practice of adding de-magnifying optics is a 

20 step in the wrong direction if the goal is to obtain diffraction-limited digital images. 

In a conventional microscope, different power objectives lenses are typically 
used to view the specimen at different resolutions and magnifications. Standard 
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microscopes have a nosepiece that holds Five objectives lenses. In an all-digital imaging 
system such as the present scanner 1 1 there is a need for only one microscope objective 
lens 1 6 with a numerical aperture corresponding to the highest spatial resolution 
desirable. The presently preferred embodiment of the scanner 1 1 provides for only one 
5 microscope objective lens 16. Once a diffraction-limited digital image has been 

captured at this resolution, it is straightforward using standard digital image processing 
techniques, to present imagery information at any desirable reduced resolutions and 
magnifications. 

The presently preferred embodiment of the scanner 1 1 is based on a Dalsa 
10 SPARK line scan camera 18 with 1024 pixels (picture elements) arranged in a linear 
array, with each pixel having a dimension of 1 4 by 1 4 micrometers: Any other type of 
linear array, whether packaged as part of a camera or custom-integrated into an imaging 
electronic module, can also be used. The linear array in the presently preferred 
embodiment effectively provides eight bits of quantization, but other arrays providing 
1 5 higher or lower level of quantization may also be used. Alternate arrays based on 3- 
channel red-green-blue (RGB) color information or time delay integration (TDI), may 
also be used. TDI arrays provide a substantially better signal-to-noise ratio (SNR) in the 
output signal by summing intensity data from previously imaged regions of a specimen, 
yielding an increase in the SNR that is in proportion to the square-root of the number of 
20 integration stages. TDI arrays can comprise multiple stages of linear arrays. TDI arrays 
are available with 24, 32, 48, 64, 96, or even more stages. The scanner 1 1 also supports 
linear arrays that are manufactured in a variety of formats including some with 512 
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pixels, some with 1024 pixels, and others having as many as 4096 pixels. Appropriate, 
but well known, modifications to the illumination system 28 and the line scan camera 
focusing optics 34 may be required to accommodate larger arrays. Linear arrays with a 
variety of pixel sizes can also be used in scanner 1 1 . The salient requirement for the 
5 selection of any type of line scan camera 1 8 is that the sample 1 2 can be in motion with 
respect to the line scan camera 1 8 during the digitization of the sample 12 in order to 
obtain high quality images, overcoming the static requirements of the conventional 
imaging tiling approaches known in the prior art. 

The output signal of the line scan camera 18 is connected to the data processor 

10 20. The data processor 20 in the presently preferred embodiment includes a central 

processing unit with ancillary electronics, for example a motherboard, to support at least 
one signal digitizing electronics board such as an imaging board or a frame grabber. In 
the presently preferred embodiment, the imaging board is an EPIX PIXCID24 PCI bus 
imaging board, however, there are many other types of imaging boards or frame 

1 5 grabbers from a variety of manufacturers which could be used in place of the EPIX 

board. An alternate embodiment could be a line scan camera that uses an interface such 
as IEEE 1394, also known as Firewire, to bypass the imaging board altogether and store 
data directly on a data storage 38, such as a hard disk. 

The data processor 20 is also connected to a memory 36, such as random access 

20 memory (RAM), for the short-term storage of data, and to the data storage 38, such as a 
hard drive, for long-term data storage. Further, the data processor 20 is connected to a 
communications port 40 that is connected to a network 42 such as a local area network 
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(LAN) : a wide area network (WAN), a metropolitan area network (MAN), an intranet, 
an extranet, or the global Internet. The memory 36 and the data storage 38 are also 
connected to each other. The data processor 20 is also capable of executing computer 
programs, in the form of software, to control critical elements of the scanner 1 1 such as 
5 the line scan camera 18 and the stage controller 22, or for a variety of image-processing 
functions, image-analysis functions, or networking. The data processor 20 can be based 
on any operating system, including operating systems such as Windows, Linux, OS/2, 
Mac OS, and Unix. In the presently preferred embodiment, the data processor 20 
operates based on the Windows NT operating system. 

10 The data processor 20, memory 36, data storage 38, and communication port 40 

are each elements that can be found in a conventional computer. One example would be 
a personal computer such as a Dell Dimension XPS T500 that features a Pentium III 500 
MHz processor and up to 756 megabytes (MB) of RAM. In the presently preferred 
embodiment, the computer, elements which include the data processor 20, memory 36. 

1 5 data storage 38, and communications port 40 are all internal to the scanner 1 1 , so that 
the only connection of the scanner 1 1 to the other elements of the system 10 is the 
communication port 40. In an alternate embodiment of the scanner 1 1 , the computer 
elements would be external to the scanner 1 1 with a corresponding connection between 
the computer elements and the scanner 1 1 . 

20 The scanner 1 1 , in the presently preferred embodiment of the invention, 

integrates optical microscopy, digital imaging, motorized sample positioning, 
computing, and network-based communications into a single-enclosure unit. The major 
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advantage of packaging the scanner 1 1 as a single-enclosure unit with the 
communications port 40 as the primary means of data input and output are reduced 
complexity and increased reliability. The various elements of the scanner 11 are 
optimized to work together, in sharp contrast to traditional microscope-based imaging 
5 systems in which the microscope, light source, motorized stage, camera, and computer 
are typically provided by different vendors and require substantial integration and 
maintenance. 

The communication port 40 provides a means for rapid communications with the 
other elements of the system 10, including the network 42. The presently preferred 

1 0 communications protocol for the communications port 40 is a carrier-sense multiple- 
access collision detection protocol such as Ethernet, together with the TCP/IP protocol 
for transmission control and internetworking. The scanner 1 1 is intended to work with 
any type of transmission media, including broadband, baseband, coaxial cable, twisted 
pair, fiber optics, DSL or wireless. 

15 In the presently preferred embodiment, control of the scanner 1 1 and review of 

the imagery data captured by the scanner 1 1 are performed on a computer 44 that is 
connected to the network 42. The computer 44, in its presently preferred embodiment, 
is connected to a display monitor 46 to provide imagery information to an operator. A 
plurality of computers 44 may be connected to the network 42. In the presently 

20 preferred embodiment, the computer 44 communicates with the scanner 1 1 using a 

network browser such as Internet Explorer from Microsoft or Netscape Communicator 
from AOL. Images are stored on the scanner 1 1 in a common compressed format such a 
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JPEG which is an image format that is compatible with standard image-decompression 
methods that are already built into most commercial browsers. Other standard or non- 
standard, lossy or lossless, image compression formats will also work. In the presently 
preferred embodiment, the scanner 1 1 is a webserver providing an operator interface 
5 that is based on webpages that are sent from the scanner 1 1 to the computer 44. For 
dynamic review of imagery data the currently preferred embodiment of the scanner 1 1 
is based on playing back, for review on the display monitor 46 that is connected to the 
computer 44, multiple frames of imagery data using standard multiple-frame browser 
compatible software packages such as Media-Player from Microsoft, Quicktime from 

1 0 Apple Computer, or RealPlayer from Real Networks. In the presently preferred 

embodiment, the browser on the computer 44 uses the hypertext transmission protocol 
(http) together with TCP for transmission control 

There are, and will be in the future, many different means and protocols by 
which the scanner 1 1 could communicate with the computer 44, or a plurality of 

15 computers. While the presently preferred embodiment is based on standard means and 
protocols, the approach of developing one or multiple customized software modules 
known as applets is equally feasible and may be desirable for selected future 
applications of the scanner 1 1 . Further, there are no constraints that computer 44 be of 
any specific type such as a personal computer (PC) or be manufactured by any specific 

20 company such as Dell. One of the advantages of a standardized communications port 40 
is that any type of computer 44 operating common network browser software can 
communicate with the scanner 11. 
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If one so desires, it is possible, with some modifications to the scanner 1 1 , to 
obtain spectrally resolved images. Spectrally resolved images are images in which 
spectral information is measured at every image pixel. Spectrally resolved images could 
be obtained by replacing the line scan camera 18 of the scanner 1 1 with an optical slit 
5 and an imaging spectrograph. The imaging spectrograph uses a two-dimensional CCD 
detector to capture wavelength-specific intensity data for a column of image pixels by 
using a prism or grating to disperse the optical signal that is focused on the optical slit 
along each of the rows of the detector. 

Turning now to FIG. 2, a block diagram of a second embodiment of an optical 
10 microscopy system 10 according to the present invention is shown. In this system 10, 
the scanner 1 1 is more complex and expensive than the currently preferred embodiment 
shown in FIG. 1 . The additional attributes of the scanner 1 1 that are shown do not all 
have to be present for any alternate embodiment to function correctly. FIG. 2 is 
intended to provide a reasonable example of additional features and capabilities that 
1 5 could be incorporated into the scanner 11. 

The alternate embodiment of FIG. 2 provides for a much greater level of 
automation than the presently preferred embodiment of FIG. 1. A more complete level 
of automation of the illumination system 28 is achieved by connections between the 
data processor 20 and both the light source 30 and the illumination optics 32 of the 
20 illumination system 28. The connection to the light source 30 may control the voltage, 
. or current, in an open or closed loop fashion, in order to control the intensity of the light 
source 30. Recall that the light source 30 is a halogen bulb in the presently preferred 
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embodiment. The connection between the data processor 20 and the illumination optics 

t - 

32 could provide closed loop control of the field iris aperture and the condenser iris to 
provide a means for ensuring that optimum Kohler illumination is maintained. 

Use of the scanner 1 1 for fluorescence imaging requires easily recognized 
5 modifications to the light source 30, the illumination optics 32, and the microscope 
objective lens 1 6. The second embodiment of FIG. 2 also provides for a fluorescence 
filter cube 50 that includes an excitation filter, a dichroic filter, and a barrier filter. The 
fluorescence filter cube 50 is positioned in the infinity corrected beam path that exists 
between the microscope objective lens 16 and line scan camera focusing optics 34. One 

10 embodiment for fluorescence imaging could include the addition of a filter wheel or 
tunable filter into the illumination optics 32 to provide appropriate spectral excitation 
for the variety of fluorescent dyes or nano-crystals available on the market. 

The addition of at least one beam splitter 52 into the imaging path allows the 
optical signal to be split into at least two paths. The primary path is via the line scan 

1 5 camera focusing optics 34, as discussed previously, to enable diffraction-limited 

imaging by the line scan camera 18. A second path is provided via an area scan camera 
focusing optics 54 for imaging by an area scan camera 56. It should be readily apparent 
that proper selection of these two focusing optics can ensure diffraction-limited imaging 
by the two camera sensors having different pixel sizes. The area scan camera 56 can be 

20 one of many types that are currently available, including a simple color video camera, a 
high performance, cooled, CCD camera, or 'a variable integration-time fast frame 
camera. The area scan camera 56 provides a traditional imaging system configuration 
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for the scanner 1 1 . The area scan camera 56 is connected to the data processor 20. If 
two cameras are used, for example the line scan camera 18 and the area scan camera 56, 
both camera types could be connected to the data processor using either a single dual- 
purpose imaging board, two different imaging boards, or the IEEE 13 94 Firewire 
5 interface, in which case one or both imaging boards may not be needed. Other related 
methods of interfacing imaging sensors to the data processor 20 are also available. 

While the primary interface of the scanner 1 1 to the computer 44 is via the 
network 42, there may be instances, for example a failure of the network 42, where it is 
beneficial to be able to connect the scanner 1 1 directly to a local output device such as a 
10 display monitor 58 and to also provide local input devices such as a keyboard and 
mouse 60 that are connected directly into the data processor 20 of the scanner 1 1 . In 
this instance, the appropriate driver software and hardware would have to be provided as 
well. 

The second embodiment shown in FIG. 2 also provides for a much greater level 
15 of automated imaging performance. Enhanced automation of the imaging of the scanner 
1 1 can be achieved by closing the focus control loop comprising the piezo positioner 24, 
the piezo controller 26, and the data processor 20 using well-known methods of 
autofocus. The second embodiment also provides for a motorized nose-piece 62 to 
accommodate several objectives lenses. The motorized nose-piece 62 is connected to 
20 and directed by the data processor 20 through a nose-piece controller 64. 

There are other features and capabilities of the scanner 1 1 which could be 
incorporated. For example, the process of scanning the sample 12 with respect to the 
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microscope objective lens 1 6 that is substantially stationary in the xly plane of the 

( 

sample 12 could be modified to comprise scanning of the microscope objective lens 16 
with respect to a stationary sample 12. Scanning the sample 12, or scanning the 
microscope objective lens 16, or scanning both the sample 12 and the microscope 
5 objective lens 16 simultaneously, are possible embodiments of the scanner 11 which can 
provi de the same large contiguous digital image of the sample 12 as discussed 
previously. 

The scanner 1 1 also provides a general purpose platform for automating many 
typies of microscope-based analyses. The illumination system 28 could be modified 

10 from a traditional halogen lamp or arc-lamp to a laser-based illumination system to 
permit scanning of the sample 12 with laser excitation. Modifications, including the 
incorporation of a photomultiplier tube or other non-imaging detector, in addition to or 
in lieu of the line scan camera 18 or the area scan camera 56, could be used to provide a 
means of detecting the optical signal resulting from the interaction of the laser energy .' 

15 with the sample 12. 

Turning now to FIGS. 3A-3C, the manner in which contiguous image strips are 
acquired by a linear array detector according to the present invention is shown. The line 
scan camera 18 of FIG. 1 observes a line scan camera field of view 70 as shown in FIG. 
3 A. The line scan camera field of view 70 comprises the region of the sample 12 of 

20 FIG. 1 that is imaged by a multitude of individual pixel elements 72 that are arranged in 
a linear fashion into a linear array 74 as shown in FIG. 3B. The linear array 74 of the 
presently preferred embodiment comprises 1024 of the individual pixel elements 72, 
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with each of the pixel elements 72 being 14 micrometers square. The physical 
dimensions of the linear array 74 of the presently preferred embodiment are 14.34 
millimeters by 14 micrometers. Assuming , for purposes of discussion of the operation 
of the scanner 11, that the magnification between the sample 12 and the line scan 
5 camera 1 8 is ten, then the line scan camera field of view 70 corresponds to a region of 
the sample 12 that has dimensions. equal to 1 .43 millimeters by 1.4 micrometers. Each 
pixel element 72 images an area about 1 .4 micrometers by 1 .4 micrometers. 

FIG. 3C illustrates that during digital scanning of the sample 12, an image 76 is 
acquired in image strips, such as image strip 77, starting with a first image strip 78, 

10 followed by a second image strip 80, and so on, until the last image strip 82 necessary to 
digitize the image 76 has been acquired. One of ordinary skill in the art will realize that 
the scanning may be either top-to-bottom or bottom-to-top or may start any point on the 
sample. The digital scanning may also involve vertical image strips rather than 
horizontal image strips. While desirable, it is also not necessary that the image strips be 

15 acquired in a contiguous manner. The image 76 can comprise the entire sample 12 or 
only a portion of the sample 12. In the presently preferred embodiment of the scanner 
1 1, the scanning and digitization is performed in a direction of travel 84 that alternates 
between image strips, as shown in FIG. 3 A. This type of bi-directional scanning 
provides for a more rapid digitization process than uni-directional scanning, a method of 

20 scanning and digitization which requires the same direction of travel 84 for each image 
strip. 

The capabilities of the line scan camera 1 8 typically determine whether scanning 
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can be done bi-directionally, as in the currently preferred embodiment of the scanner 1 1 . 
or uni-directionally. Uni-directional systems often comprise more than one linear array 
74, such as a three channel color array 86 or a multi-channel TDI array 88 shown in 
FIG. 3B. The color array 86 detects the RGB intensities required for obtaining a color 
5 image. An alternate embodiment for obtaining color information uses a prism to split 
the broadband optical signal into the three color channels. The TDI array 88 could be 
used in an alternate embodiment of the scanner 1 1 to provide a means of increasing the 
effective integration time of the line scan camera 1 8, while maintaining a fast data rate, 
and without significant loss in the signal-to-noise ratio of the digital imagery data. 

1 0 Turning now to FIG. 4. a simplified flow chart of the operation of an optical 

microscopy system 10 according to the present invention is shown. The sample 12 is 
loaded into scanner 1 1 at step 200. The simplest method of sample loading is for an 
operator to physically place or position the sample 1 2 on the motorized stage 14. The 
most advanced method of sample loading is for the scanner 1 1 to automatically load one 

1 5 or multiple samples 12 from a sample cassette that has been previously loaded. Other 
embodiments for sample loading are known in the art. In the presently preferred 
embodiment of this invention, sample loading is performed manually to reduce system 
cost and mechanical complexity. 

The scanner 1 1 is initialized at step 201 by commands issued from the computer 

20 44, or similarly from buttons that may be part of an alternate embodiment of the scanner 
11. Initialization parameters, including the desired resolution of the digitization process, 
the portion of the sample 12 to be digitized to create the image 76, and the name of a 
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relevant calibration file are entered by an operator at step 201 . The scanner 1 1 defaults 
to digitizing the entire sample unless instructed otherwise. It is important to note that 
after loading the sample and initializing the scanner, there should be no need for the 
manual intervention of the operator in the image acquisition process that follows. 
5 The automatic scanning and digitization of the sample 12 into the image 76 

includes steps 202 through 210. These steps are orchestrated by the data processor 20 
which synchronizes the read-out of imager}' data from the line scan camera 1 8 one line 
or image strip at a time, while the sample 12 is moved at substantially constant velocity 
on the motorized stage 14 that is under control of the stage controller 22. The scanner 

10 11 commences the automatic digitization of the sample 12 at step 202 with the 

movement of the sample 12 and the acquisition of a single line image from the line scan 
camera 18, starting in a predetermined region of the sample 12, for example the upper 
left-hand corner of the sample 12 as shown in FIG. 3C. In step 202, the motorized stage 
14 is moved with respect to the line scan camera 1 8 in the bi-directional back and forth 

1 5 manner discussed previously. The control logic of the decision block of step 204 
determines whether the end of an image strip, such as the image strip 77, has been 
reached. There are many possible ways to implement this logic, some without position 
feedback from a position encoder. For example, the total number of image lines read 
out by the line scan camera 1 8 could be used as a means of knowing when the end of the 

20 image strip has been reached. Other parameters such as total elapsed scan time or 

calibration markings that are part of, or positioned in close proximity to, the sample 18 
could also be used. Optical limit switches are provided in the motorized stage 14 of the 
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presently preferred embodiment of the scanner 1 1 to indicate when it is time to 
reposition the motorized stage 1 4 for a new scan. If the end of the image strip 77 has 

a 

not been reached at step 204, then the digitization process continues with step 202, the 
acquisition of the next line image. The sample 12 continues to move at approximately 
5 constant velocity at all times during the digitization process, and any required focus 
adjustments are made in parallel with the on-going motion of the mechanical stage 14 as 
indicated in step 206. Because the focus will not change dramatically from one image 
strip to the next, focus adjustments are made relatively slowly and gradually, Assuming 
again, for purposes of discussion of operation of the scanner 1 1 , that the area of the 

10 sample 12 to be digitized at a magnification of 1 Ox is 50 millimeters by 25 millimeters, 
then eighteen image strips, similar to the image strip 77, each of dimension 1 .43 
millimeters by 50 millimeters must be acquired to generate the image 76. Each image 
strip 77 would comprise about 36,000 by 1024 pixel elements, with the entire image 76 
comprising approximately 36,000 by 1 8,000 pixels. Unless and until the process of 

15 digitizing the desired portion of the sample 12 to create the image 76 has finished, as 
determined by the decision logic of step 208, the positioning of the sample 12 for a new 
scan occurs at step 210. Step 210 includes movement of the motorized stage 14 from 
one image strip to another in order to position the motorized stage 14 for a new scan. 

The total time required to acquire the image 76 is proportional to the line rate at 

20 which the line scan camera 1 8 can digitize information. In the presently preferred 

embodiment of the scanner 1 1, the line rate is 27,600 lines per second, or 28.3 million 
pixels per second, for the DALSA SPARK model SP 12-01 K30 that is used. At a line 
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rate of 27.600 pixels per second, each image strip 77 comprising, for purposes of 
discussion, 36,000 by 1024 pixels can be digitized in about 1 .3 seconds 
(36,000/27,600). The motorized stage 14 in the present embodiment thus moves at 
approximately 38 millimeters per second along the x-axis, covering the entire length of 
5 the 50 millimeters image strip 11 during these 1 .3 seconds. Since the image 76 

comprises 18 image strips 77, 23.4 seconds are required to digitize the desired portion of 
the sample 1 2. As discussed previously, this time is only valid for a bi-directional line 
scan camera, such as used in the preferred embodiment of the present invention, that can 
scan from right to left and also from left to right alongHhe x-axis. An alternated 

10 embodiment could utilize a uni -directional type of the line scan camera which can scan 
only from left to right. In this case, the motorized stage 14 is returned at maximum 
stage velocity to the same left reference position along the x-axis and all image strips, 
such as the image strip 77, are acquired in a uni-directional manner going only from left 
to right. After completing the digitization of an individual image strip, such as the 

15 image strip 77, the motorized stage 14 decelerates, comes to a stop, moves downward 
along the j/-axis and accelerates again to scan the subsequent image strip. Allowances, 
in both time and distance, have to be made for the motorized stage 14 to accelerate and 
decelerate at the beginning and end of each image strip that is scanned so as to ensure 
that the motorized stage 14 is moving at substantially constant velocity during the 

20 scanning and digitization process. The additional time required for acceleration and 

deceleration depends on the x-axis performance of the motorized stage 14 and the x-axis 
attributes of the stage controller 22. In the presently preferred embodiment, the 



WO 01/84209 



-37- 



PCT/US01/08028 



acceleration and deceleration times, using S -curve profiles for smooth motion and 
minimum jerk, are approximately 0.7 seconds. The consideration of acceleration and 
deceleration of the motorized stage 14 require that during the new scan set-up 
comprising step 210, the line scan camera 18 moves off the edges of the portion of the 
5 sample 12 that is to be digitized. The new scan set-up time depends on the particulars- 
axis performance of the motorized stage 14, and the j/-axis attributes of the stage 
controller 22, and is approximately one-half second in the presently preferred 
embodiment of the invention. Thus, a total of 25.2 seconds, obtained by multiplying 18 
image strips times 1.4 seconds, are added for acceleration and deceleration along the x- 

10 axis at the beginning and end of each image strip, and an additional nine seconds are 
added to reposition the motorized along the >>-axis for the next scan. The total time 
required for all portions of the process required to capture the image 76 in the present 
• example is therefore about one minute for a bi-directional scanning embodiment. 

The scanner 1 1 can be further optimized to minimize the total acquisition time of 

1 5 the image 76 even more. The image acquisition time that can be achieved by the 

scanner 1 1 depends in part on the line rate of the line scan camera 1 8. At the line rate of 
27,600 lines per second of the present example, each line image is captured in about 
0.04 milliseconds. Illumination from the light source that includes a 50 watt bulb, 
provides sufficient light to register a signal with sufficient signal-to-noise ratio on the 

20 line scan camera. At faster read-out rates, the exposure time per line is reduced and 
improvements and enhancements to the illumination system 28 of the scanner 1 1 may 
be required. Similarly, for applications of the scanner 1 1 in which less light is available. 
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for example fluorescence, the effective line integration time must be increased. A TDI 
type of line scan camera provides an excellent means of increasing the effective 
integration time while maintaining a fast data read-out, without significant loss in the 
signal-to-noise ratio of the imagery data. 
5 Faster line scan cameras are commercially available and can be synchronized 

with faster motorized stages. Alternatively, selection of a linear array, such as linear 
array 74, but with more than 1024 pixel elements 72 would reduce the number of image 
strips that have to be scanned to capture image 76, and require fewer acceleration and 
deceleration cycles. Arrays comprising 2048 or more pixels often have proportionately 

10 smaller line rates than arrays with 1024 pixels. The reduced line rate of such larger 

arrays has the dual benefit of reducing the maximum velocity required by the motorized 
stage 14, while increasing the line integration time, all without a reduction in total 
image capture time. The disadvantage of larger format linear arrays is that larger and 
more expensive optics and illumination systems are required to provide a high quality 

1 5 optical signal without vignetting and other optical aberrations. It is even possible to use 
multiple sensors to reduce the overall image acquisition time further. 

The scanner 1 1, in its presently preferred embodiment, performs the digitization 
of the sample using microscope objective lenses having a relatively large depth of field 
so as to eliminate or minimize the cost and complexity of dynamic autofocus. The 

20 theoretical depth of fieUfof an objective lens with numerical aperture (NA) of 0.15 is 
greater than twenty micrometers. The depth of field degrades to about five micrometers 
at NA equal to 0.3 and to about 1.8 micrometers at NA equal to 0.5. Depending on the 
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application, the entire sample or portions of the sample 12 may be scanned without any 
need to adjust the focal plane, even when using objective lenses with moderate 
numerical apertures. Selection of relatively low NA objective lenses is consistent with 
one application of the scanner 1 1 in which it is used as an aid to extensive manual 
5 scanning of the sample 12. Such conventional manual scanning is typically performed 
at low numerical apertures and low magnifications. The image 76 of the sample 12 can 
thus be used cost-effectively as the basis for a subsequently higher resolution . 
interrogation of selected areas of the sample 12. Based on the decision logic that 
comprises step 220. either a conventional optical microscope as indicated in step 222 or 

10 a higher resolution embodiment of the scanner 1 1 as shown in step 224 can be used for 
the higher resolution review of the sample 12. In the latter case, dynamic autofocus may 
be necessary. The high-resolution digitization of an entire sample 12, such as a 
microscope slide, or large portions of the sample 12, may not be practical or cost- 
effective using currently available computing power. However, future cost reductions 

1 5 of, and improvements in, data processing, memory, and data storage are expected to 
make high-resolution rapid digitization a reality. 

The need for focusing during scanning is indicated in step 206 and is very much 
dependent on the particular application of the scanner 11.. The scanner 1 1 uses a 
calibration method in which a standardized calibration sample of predetermined shape 

20 and size is digitized and the best focus is determined as a function of the xly position of 
the motorized stage 14 using methods that are well known in the art. During the 
scanning and digitization process, the position of the microscope objective lens 16 is 
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moved in accordance with this xly focus map. Many different approaches to autofocus 
are known in the art that could be used to change the relative position of the microscope 
objective lens 1 6 with respect to the sample 12. A vertical (z) axis component of the 
motorized stage 14 can be used for autofocus, although the presently preferred method 
5 of the invention is to move the microscope objective lens 1 6 instead using the 
commercially available piezo positioner 24. While the total range of the piezo 
positioner 24 that is attached to the microscope objective lens 16 is relatively small, 
typically 100 micrometers, the bandwidth of a piezo is higher than that of a heavy 
motorized stage. The higher piezo bandwidth, typically 150 Hertz, is more desirable 
10 than a stiffer mechanical stage to minimize vibrations associated with small focus 
changes. 

One of the benefits of the scanner 11 is the rapid digitization of a large portion of 
the sample 12, in order to provide the image 76 that can be. processed efficiently and 
cost effectively when compared to labor intensive manual scanning of the sample 12. 

1 5 Consistent with this, the scanner 1 1 , in its most basic embodiment, does not require the 
complexity of dynamic autofocus that is found in some conventional imaging systems. 
Pre-scanning and mapping of the best focus as a function of xly position provides 
adequate focus for most applications. An alternate but more expensive embodiment of 
the scanner 1 1 provides extensive autofocus capabilities using an ancillary area scan 

20 camera such as the area scan camera 56. More advanced calibration methods in which 
the spatial information for autofocusing is part of the sample 12, for example, a glass 
microscope slide with calibration markings, are also possible. 
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The overall quality of the image 76 is related to the ability of the sample 12 to be 
moved at substantially constant velocity. Sampling errors leading to image distortion 
can occur if the synchrony between the line scan camera 1 8 and the motorized stage 14 
are not adequately preserved. Depending on the application and the need for image 
5 resolution, the scanner 1 1 supports different approaches for capturing data in synchrony 
with sample movement. Pre-scanning of a calibration target of known shape, for 
example a Ronchi ruling on a microscope slide, is one means, by which the scanner 1 1 
achieves constant sample velocities. Capabilities are provided in the data processor 20 
to control both the time profile of position commands that are sent to the motorized 

1 0 stage 1 4 and to dynamically change the line data read-out rate of the line scan camera 
18. Since the majority of velocity related errors in the motorized stage 14 are 
reproducible, the optimization of the position profile or the optimization of the line scan 
camera 1 8 readout-rate, so as to obtain optimum images during the calibration scan is 
sufficient to provide excellent images when the sample 12 is subsequently scanned and 

15 digitized. An alternate embodiment of the scanner 1 1 that is more suitable for digitizing 
high-resolution images utilizes position feedback from the motorized stage 14. The 
presently preferred embodiment of the scanner 1 1 is able to generate high quality 
images at low to moderate resolutions using calibration methods applied to a calibration 
target, without the need for feedback from expensive position encoders. 

20 Assuming that the 36,000 by 18,000 pixel image discussed previously as an 

example is captured at eight bits (one byte) of quantization per pixel, 648 million bytes 
(megabytes or MB) of RAM are required to store all of the data for all of the image 
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strips 77 in their uncompressed raw format in the memory 36. A plurality of image 
strips 77 are assembled into the image 76 during step 212. There are many possible 
ways to assemble the image from the multiple image strips 77 acquired during the 
digitization of the sample 12. The image assembly method of the currently preferred 
5 embodiment of the invention is to scan the sample 12 so as to slightly overlap the image 
strips 77, for example by 10-20 pixels, and to use these overlapping pixels to fine-tune 
the xly alignment of the image strips 77 into a contiguous image 76. Using JPEG or 
other image compression methods, the data size of the image 76, or the size of 
individual image strips 77. can be reduced to five to ten percent, or less, of their original 

10 size — in many cases without appreciable loss in the information content required by a 
particular application. The scanner 1 1 is also capable of eliminating from the image 76 
those empty areas that do not contain any meaningful imagery data, further reducing the 
data storage requirements of the image 76. 

One of the motivations for digitizing the sample 12 into a large contiguous 

1 5 image 76, typically at the low to moderate optical resolutions that are used for manually 
scanning of the sample 12 under a conventional optical microscope, is to be able to 
apply specialized computer programs to the resulting imagery data. In step 214, the 
analysis of the image 76 that represents a digitized portion of the sample 12, comprises a 
variety of methods such as the application of morphological algorithms to identify and 

20 locate specific types of objects in the image 76, for example, normal or abnormal cells. 
Other examples of analysis methods functions might include counting or measuring 
algorithms, or comparison or quality assurance algorithms to identify defects in the 
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image 76, or other types of algorithms to differentiate the image 76 from previously 
measured similar images. It should be clear that once the digitization of the image of 
the sample 12 has been completed, the analysis methods that comprise step 214 do not 
require that the sample 12 be physically present or available. The methods of step 214 
5 can be applied automatically, or as part of an iterative process involving an operator 
who interactively reviews the image 76 as shown in step 216, on the computer monitor 
46 that is connected to the scanner 1 1 via the network 42. 

A decision to return for a high resolution interrogation of selected areas of the 
sample 12, using information obtained from the image 76, for example object 

10) coordinates obtained from the analysis of the image 76 in steps 214 and 216, is made as 
part of step 218. If the decision logic in step 218 does not return the analysis to the 
sample 12, then the operator's task is complete. If the operator wishes to return to the 
sample 12 as part of step 218, the decision logic of step 220 determines whether the 
high-resolution interrogation is conducted on a conventional optical microscope as 

1 5 shown in step 222, or using the scanner 1 1 as per step 224. It should be realized that 
coordinate information obtained from a low to moderate resolution analysis of the image 
76 is sufficient to guide the higher resolution interrogation of the sample 12 on a 
conventional microscope. The high-resolution review of the sample 12 using the 
scanner 1 1 comprises step 224 and includes the ability to remotely control the scanner 

20' 1 1 using many of the previously described features of the alternate embodiment of FIG. 
2. For example, the position of the motorized stage 14, as well as the position of the 
piezo positioner 24, and the illumination intensity of the light source 30 may be under 
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remote control of the operator during step 224. Real-time imagery, for example from 
the area scan camera 56 may be the basis for this review rather than digitized 
information from the sample 12. Alternatively, the operator may select smaller portions 
of the sample 12 to be digitized at higher resolutions using either the line scan camera 
5 18 or the area scan camera 56. In the former case, the process would return to the steps 
202 through 210 comprising the digitization of the sample 12 and then return directly to 
step 224. Autofocus would be utilized as required based on the size of the portion of the 
sample 12 to be digitized and the depth of field of the microscope objective lens 16 that 
is utilized. 

10 Turning now to FIGS. 5A-5B, a schematic of an image viewing frame 100 

according to the present invention is shown which represents one embodiment of a 
graphical user interface for displaying the image 76 on the display monitor 46 for 
purposes of interactive reviewing of the image 76 as per step 216. The display of the 
image 76 that may be on the order of 36,000 by 1 8,000 pixels or larger, such as the 

15 image 76 described in a prior example, is not possible on a conventional monitor or 

display device such as display monitor 46. The maximum number of pixels on currently 
available monitors such as a 19-inch Hitachi CM751 monitor is about 1600 by 1200 
pixels, with 1024 by 768 pixels being more typical. Only portions of the image 76 can 
therefore be displayed at any one time at the full resolution of the entire image 76. 

20 However, it is possible to display a macro image 1 02, that is a reduced resolution 
version of the image 76 on the display monitor 46, together with a higher resolution 
zoom image 104 that corresponds to a portion of the image 76. The region of the macro 
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image 102 that is displayed in the zoom image 104 is indicated on the macro image 102 
itself as a zoom region 106 that can be interactively sized and moved over the entire 
macro image 102 by the operator. In its simplest embodiment, the zoom region 106 is a 
fixed rectangular region, but other icons or shapes, including manually drawn regions, 
5 could also be implemented. The zoom region 106 provides a critical reference between 
the macro image 102 and the zoom image 104, An expanded view of the macro image 
102 is shown in FIG. 5B, highlighting the presence, for illustrative purposes only, of 
eight schematic objects in the macro image 102, shown here as four circles and four 
rectangles and designated as 01 108, 02 1 10, 03 1 12, 04 1 1 4, 05 1 16, 06 1 1 8, 07 1 20 

10 and 08 122. Each of the objects in a similar class, in this case similar shape, are 

distinguished from the other objects in the same class by a unique pattern. The use of 
very simple objects is intended only to illustrate and clarify the relationship between the 
different types of information displayed in the image viewing frame 100. In this case, 
objects. Ol 108 and 02 1 12 are within the zoom region 106 and are thus displayed in the 

15 zoom image 104 that is part of an operator sizable zoom window 124. The user has the 
ability, using icons that are part of a user command window 126 that is also part of the 
image viewing frame 100, to increase the electronic zoom of the zoom image 104. In 
one embodiment, these icons would be clicked using a mouse as a pointing device, 
however other means of pointing to an icon or invoking the function associated with an 

20 icon are known in the art and can be used here as well. Command icons may be 
incorporated into any of the windows that are part of the image viewing frame 1 00, 
including the user command window 126. For example, an electronic zoom icon can be 
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part of the zoom window 124. As the electronic zoom is increased, the size of the zoom 
region 106 is decreased on the macro image 102 so as to maintain a constant sized zoom 
image 104. 

General information about any of the images can be displayed as part of the 
5 window corresponding to that image. For example, a macro window 128 might display 
the size of the macro image 102 in pixels, the size of the zoom region 106 in pixels, and, 
the center pixel coordinates of the zoom region 106. The zoom window 1 24 might 
display the amount of electronic zoom applied to the zoom image 104 together with a 
reference to a physical dimension. The size and shape of all windows such as the macro 

10 window 128 and the zoom window 124 can be changed interactively by the operator, 
similar to the way that any windows-based software operates, to accommodate different 
sample types with different aspect ratios. 

The results of step 214, the application of specialized computer programs to the 
image 76, are displayed in an object window 130 of the image viewing frame 100. The 

1 5 object window 1 30 in the presently preferred embodiment of this invention comprises a 
multitude of object images, such as object image 1 32, that each correspond to different 
portions of the large contiguous digital image 76. Depending on their size, the object 
images 132 can be displayed as reduced resolution thumbprint images in an image 
gallery type arrangement. Clicking or pointing in one of the object images 132 also 

20 results in display of that the object image 132 at full resolution as the zoom image 104 
that is part of the zoom window 124. The criteria for displaying object images 132 in 
the object window 130 are based on the specialized computer programs that are applied 
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to the image 76 in step 214. In the present example, the specialized computer program 
would use simple boundary detection and segmentation algorithms to search the image 
76 for the presence of all objects, in this case objects 01 108 through 08 122, and 
display these objects as object images 132 in the object window 130. A different 
5 specialized computer program, for example one that is capable of counting objects and 
distinguishing circles from squares, could then be applied to each of the object images 
132 to provide a further level of classification. The results, in this case numerical 
results, could be displayed in an analysis window 134 of the image viewing frame 100. 
' The analysis window 134 in the present example could contain the total count of 

10 objects, in this case eight, as well as the total count of objects in either of the two classes 
of shapes, square and round. There are many types of specialized computer programs 
which could be applied to the image 76, and many types of object images 132 which 
could be displayed in the object window 130 as a result of applying such specialized 
computer programs to the image 76. Also, there are many types of more refined 

1 5 specialized computer programs that could be applied to the multitude of object images 
1 32 to provide a higher level of object classification for subsequent display in the 
analysis window 134 in a variety of formats. The user commands window 126 of the 
image viewing frame 100 provides a window for interactively selecting the attributes of 
the image analysis that is performed as part of step 214, and the criteria for the review of 

20 the image 76 in step 2 1 6. 

Turning now to FIGS. 6A-6B, a schematic of a dynamic image viewing frame 
1 50 which represents a graphical user interface according to the present invention for 
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dynamically displaying the image 76 on the display monitor 46 for purposes of 
interactive reviewing the image 76 as per step 216. The method of interactively 
reviewing the image 76 is intended to offer a digital imaging alternative to manually 
scanning the sample 12 at low to moderate resolutions under a conventional microscope 
5 while at the same time viewing the optical signal through the eyepieces of the 

microscope. One of the objects of the presently preferred invention is to provide a 
means of replacing manual scanning of the sample 12 by dynamically viewing the 
image 76 that is a digitization of a portion of the sample 12, and preferably a diffraction- 
limited digitization of the sample 12, on the display monitor 46. There are many 

1 0 advantages to this approach, including a more comfortable and controlled viewing 

environment in which intelligent scanning and electronic zooming methods applied to 
•the digital imagery data can increase the productivity of an operator charged with 
finding selected objects, for example abnormal cells, in the image. Specific objects that 
are identified can then be relocated, depending on the decision logic of steps 218 and 

1 5 220, under a conventional microscope or using the scanner 1 1 . Another advantage, 
afforded by the connection of the scanner 1 1 to the network 42, is that the dynamic 
review of the image 76 can be performed remotely without requiring access to the 
sample 12. Further, reviewing a digitized version of the sample 12, namely the image 
76, lends itself to a variety of techniques for monitoring the specific areas of the image 

20 76 that have been viewed. It is also straightforward to measure the time that the 
operator has spent viewing specific areas of the image 76. 

The dynamic image viewing frame 1 50 includes the same macro image 102 



r 
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within the macro window 128 as that in the previously discussed image viewing frame 
1 00 of FIG. 5 A. The dynamic image viewing frame 1 50 also includes the zoom image 
104 within the zoom window 124 and the zoom region 106 that relates the macro image 
1 02 to the zoom image 1 04, similar to the image viewing frame 1 00 described 
5 previously. While the size of all windows can be changed by the operator, the zoom 
window 124 in the dynamic image viewing frame 1 50 will typically be smaller than in 
the previously described image viewing frame 100 to allow a movie image 152 to be 
displayed with sufficient resolution within a movie window 154. The movie image 152 
is a full resolution dynamic image that is updated, as required, to simulate scanning the 

1 0 image 76 at a speed and direction determined by the operator. Returning again to the 
example of an image, such as the image 76, that is 36,000 by 1 8,000 pixels, the movie 
image 152 could be generated by dividing the large image 76 into multiple movie image 
strips 1 56 that can be displayed at a user-selectable resolution on the display monitor 46. 
For example, if the desired movie image resolution is 600 by 600 pixels, then the image 

1 5 76 would be divided into thirty movie image strips 156 of 600 by 36,000 pixels, or 
alternatively, into sixty movie image strips 156 of 600 by 18,000 pixels. The movie 
image strip 1 56 is then displayed in the movie window 1 54 of the dynamic image 
viewing frame 150 so as to simulate scanning of the image 76 of the sample 12. One 
way to simulate this scanning along either the x- or.y-axis is to remove at least one 

20 previously shown column of pixels along one edge of the movie image 1 52 while 

adding at least one new column of image pixels along the opposing edge of the movie 
image 152. A series of movie images 152 that differs from each other as described can 
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comprise the individual frames of a digital movie that is played and displayed in the 
movie window 154 on the display monitor 46 using conventional browser software such 
as Media Player from Microsoft. This type of simulated scanning is similar to what 
might be observed in the binoculars of a conventional microscope while manually 
5 scanning the sample 12. 

One potential disadvantage of this type of simulated scanning of the image 76 of 
the sample 12 is that objects in the movie image 152 are typically in motion, making it 
more challenging for an operator to identify objects, or requiring the operator to execute 
multiple stop-and-go commands during the process of scanning the image 76 of the 

10 sample 12. An alternate scanning method without the negative effects of motion can 
also be achieved with the scanner 1 1 . This alternate process comprises dividing the 
movie image strip 156 into contiguous image fields of, for example, 600 by 600 pixels 
each, and then displaying these contiguous images one at a time, preferably with some 
overlap between images, as a series of movie images 1 52. The specific reference to a 

15 600 by 600 pixel image is only meant to illustrate the principles of the idea, as images 
of other size can also be used. It should be apparent that there are many methods for 
dynamically reviewing the image 76 that provide an advantage over viewing the sample 
12 on a conventional microscope. A scan tracker 1 58 could be shown on the macro 
image 102 itself to indicate those regions of the image 76 that have previously been 

20 viewed as movie images 152. Since the operator can control the speed of the simulated 
scanning of the image 76, the operator may spend more time on some areas than on 
others. The scan tracker 158 could be color coded, for example, to indicate relative 
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dwell times, providing immediate feedback to the operator regarding the thoroughness 
of the review of the image 76. Other more advanced simulated image scanning methods 
are also possible. For example, specialized computer algorithms might rank areas of the 
image 76 in terms of their importance and present the movie images 152 according to 
5 such relative importance criteria. For sparse images, empty areas could be skipped 
entirely, making the operator more efficient by not requiring viewing of essentially 
blank fields on the image 76. Specialized computer algorithms could be employed to 
eliminate from the movie image 152 certain elements of the image 76. For example, 
clutter or objects or cells that may not be important for the analysis of image 76, or may 

1 0 not be relevant in making a diagnosis associated with image 76, could be eliminated 
from the image 76 prior to the display of the movie image 1 52. Ergonomic controllers 
such as joysticks, trackballs, gamepads, or footpedals could also be utilized to provide 
further performance improvements over clicking and pointing icons or buttons in the 
user commands window 126 of the dynamic image viewing frame 150. Examples of 

15 functions that could be useful to dynamically review the image 76 include functions 
such as forward play, backward play, fast forward, rewind, pause, loop, and other 
functions similar to what can be found in a conventional video playing or editing 
environment. It should also be realized that depending on the circumstances, there may 
be a need to store individual image frames, object coordinates, or other data for future 

20 reference or subsequent review of the image 76. 

While the invention has been illustrated and described by means of specific 
embodiments, it is to be understood that numerous changes and modifications may be 
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made therein without departing from the spirit and scope of the invention as defined in 
the appended claims and equivalents thereof. 
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CLAIMS 

1 . A scanner for automatically digitizing at least a portion of a microscope 
2 sample having a primary sample plane defined by a surface of the sample having the 

maximum area, the scanner comprising: 
4 a motorized stage for mounting and moving the sample in a first manner and a 

second manner, the first manner being movement of the sample in the sample plane at 

.r 

6 substantially constant velocity between a predetermined first position and a 

predetermined second position along a primary axis of travel defined by the first 

8 position and the second position, the second manner being movement of the sample 

along a secondary axis that is orthogonal to the primary axis of travel and in the sample 
10 plane; 

an illumination system whereby at least one portion of the sample is illuminated; 

12 at least one microscope objective lens positioned along an optical axis centered 

( 

about the portion of the sample illuminated by the illumination system and orthogonal 
14 to the sample plane; 

focusing optics whereby an optical signal from the microscope objective lens is 
16 focused onto an image plane that is orthogonal to the optical axis; 

at least one camera comprising a plurality of light-responsive elements disposed 
1 8 in at least one linear array, the light-responsive elements positioned in the image plane 
with respect to the motorized stage such that the camera has a linear field of view of a 
20 region of the sample on the motorized stage illuminated by the illumination system and 
orthogonal to the primary axis of travel; and 
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22 a data processor for digitizing, processing, and storing light intensities from the 

plurality of light-responsive elements in synchrony with predetermined sample motion, 

24 the sample motion being movement of the sample in the first manner to acquire a first 
image strip of the sample followed by movement of the sample in the second manner to 

26 position the camera for acquiring a second contiguous image strip, and repeating the 
sample motion as necessary so as to digitize the portion of sample for purposes of 

28 generating a complete image of the portion of the sample. 

2. The scanner as defined in claim 1, further comprising a stage controller 
2 connected between the motorized stage and the data processor whereby the data 

processor determines the position of the motorized stage. 

3 . The scanner as defined in claim 1 , wherein the motorized stage is capable 
2 of moving the sample in a third manner being movement of the sample along the optical 

axis. y 

4. The scanner as defined in claim 1, further comprising a piezo positioner 
2 attached to the at least one microscope objective lens for moving the objective lens 

along the optical axis. 

5. The scanner as defined in claim 4, further comprising a piezo controller 
2 connected between the piezo positioner and the data processor whereby the data 

processor directs the piezo positioner. 

6. The scanner as defined in claim 1, wherein the motorized stage 
2 comprises a plurality of stepper motors. 

7. The scanner as defined in claim 1 5 wherein.the motorized stage 
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2 comprises a plurality of servo motors and a plurality of position encoders. 

8. The scanner as defined in claim 1 , wherein the illumination system 
2 comprises a light source and illumination optics. 

9. The scanner as defined in claim 8, wherein the light source and 
2 illumination optics are optimized for transmission mode optical microscopy. 

10. The scanner as defined in claim 9, wherein the light source comprises a 
2 variable intensity halogen lamp, a concave reflective mirror, and a heat suppression 

filter. 

1 1 . The scanner as defined in claim 8. wherein the light source and 

2 illumination optics illuminate at least one substantially circular portion of the sample. 

12. The scanner as defined in claim 8, wherein the light source and 
2 illumination optics are optimized for reflection mode optical microscopy. 

13. The scanner as defined in claim 8, wherein the light source and 
2 illumination optics are optimized for fluorescence mode optical microscopy. 

14. The scanner as defined in claim 8, wherein the light source and 

2 illumination optics are each connected to the data processor whereby the data processor 
maintains optimum illumination. 

15. The scanner as defined in claim 1 , wherein the at least one microscope 
2 objective lens is of the infinity-corrected type. 

1 6. The scanner as defined in claim 1 , wherein the focusing optics comprises 
2 a tube lens optic mounted inside of a mechanical tube. 

17. The scanner as defined in claim 16, wherein the tube lens optic is 
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2 selected to provide diffraction-limited imaging. 

1 8. The scanner as defined in claim 1 , wherein the at least one camera 
2 comprises a line scan camera. 

1 9. The scanner as defined in claim 1 8, wherein the line scan camera is 
2 capable of bi-directional scanning. 

20. The scanner as defined in claim 1 , further comprising a memory 
2 connected to the data processor whereby data is stored. 

21 . The scanner as defined in claim 1, further comprising a communications 
2 port connected to the data processor whereby the scanner communicates with at least 

one computer via a network. 

22. The scanner as defined in claim 1 , further comprising a fluorescence 
2 filter cube positioned along the optical axis between the at least one microscope 

objective lens and the focusing optics. 

23. The scanner as defined in claim 1, further comprising a beam splitter 

2 positioned along the optical axis between the at least one microscope objective lens and 

the focusing optics whereby the optical signal from the microscope objective lens is 
4 split into at least a second optical axis. 

24. The scanner as defined in claim 23, further comprising: 

2 second focusing optics whereby the optical signal from the beam splitter is 

focused onto a second image plane that is orthogonal to the at least a second optical 
4 axis; and 

at least a second camera comprising a plurality of light-responsive elements 
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6 positioned in the second image plane; ' 

wherein the second camera is connected to the data processor. 

25.. The scanner as defined in claim 24, wherein the at least a second camera 
2 comprises an area scan camera. 

26. The scanner as defined in claim 1 , further comprising: 

2 a motorized nose-piece capable of holding a plurality of microscope objectives 

lens; and 

4 at least a second microscope objective lens; 

/ wherein both the at least one and the at least a second microscope objective 
6 lenses are held by the motorized nose-piece 

27. The scanner as defined in claim 26, further comprising a nose-piece 

2 controller connected between the motorized nose-piece and the data processor whereby 
the data processor selects from among the plurality of microscope objective lenses held 
4 by the motorized nose-piece. 

28. The scanner as defined in claim 1 , further comprising a motorized nose- 
2 piece capable of holding and moving the at least one microscope objective lens in a first 

manner and a second manner, the first manner being movement of the microscope 
4 objective lens parallel to the sample plane at substantially constant velocity between a 

predetermined first position and a predetermined second position along a primary axis 
6 of travel defined by. the first position and the second position, the second manner being 

movement of the microscope objective lens along a secondary axis that is orthogonal to 
8 the primary axis of travel and in the sample parallel plane. 
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29. The scanner as defined in claim 28, further comprising a nose-piece 

2 controller connected between the motorized nose-piece and the data processor whereby 
the data processor determines the position of the microscope objective lens held by the 
4 motorized nose-piece. 

30. The scanner as defined in claim 1 , further comprising a local output 

2 device and at least one local input device each connected to the data processor of the 
scanner. 

31. A scanner for automatically digitizing at least a portion of a microscope 
2 sample having a primary sample plane defined by a surface of the sample having the 

maximum area, the scanner comprising: 
4 a stage for mounting the sample; 

an illumination system whereby at least one portion of the sample is illuminated; 
6 at least one microscope objective lens positioned along an optical axis centered 

about the portion of the sample illuminated by the illumination system and orthogonal 
8 to the sample plane; 

a motorized nose-piece capable of holding and moving the at least one 
1 0 microscope objective lens in a first manner and a second manner, the first manner being 
movement of the microscope objective lens parallel to the sample plane at substantially 
12 constant velocity between a predetermined first position and a predetermined second 

position along a primary axis of travel defined by the first position and the second 
14 position, the second manner being movement of the microscope objective lens along a 
secondary axis that is orthogonal to the primary axis of travel and in the sample parallel 
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16 plane; 

focusing optics whereby an optical signal from the microscope objective lens is 
1 8 focused onto an image plane that is orthogonal to the optical axis; 

at least one camera comprising a plurality of light-responsive elements disposed 
20 in at least one linear array, the light-responsive elements positioned in the image plane 

with respect to the stage such that the camera has a linear field of view of a region of the 
.22 sample on the stage illuminated by the illumination system and orthogonal to the 

primary axis of travel; and 
24 a data processor for digitizing, processing, and storing light intensities from the 

plurality of light-responsive elements in synchrony with predetermined microscope 
26 objective lens motion, the microscope objective lens motion being movement of the 

microscope objective lens in the first manner to acquire a first strip image of the sample 
28 followed by movement of the microscope objective lens in the second manner to 

position the camera for acquiring a second contiguous strip image, and repeating the 
30 microscope objective lens motion as necessary so as to digitize the portion of sample for 

purposes of generating a complete image of the portion of the sample. 

32. The scanner as defined in claim 3 1 , further comprising a nose-piece 

2 controller connected between the motorized nose-piece and the data processor whereby 
the data processor determines the position of the microscope objecti ve lens held by the 
4 motorized nose-piece. 

33. The scanner as defined in claim 3 1 , wherein the stage further comprises a 
2 motorized stage for mounting and moving the sample in a first manner and a second 
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manner, the first manner being movement of the sample in the sample plane at 
4 substantially constant velocity between a predetermined first position and a 

predetermined second position along a primary axis of travel defined by the first 
6 position and the second position, the second manner being movement of the sample 

along a secondary axis that is orthogonal to the primary axis of travel and in the sample 
8 plane. 

34. The scanner as defined in claim 33, further comprising a stage controller 
2 connected between the motorized stage and the data processor whereby the data 

processor determines the position of the motorized stage. 

35. An optica] microscopy system for automatically digitizing and reviewing 
2 at least a portion of a microscope sample having a primary sample plane defined by a 

surface of the sample having the maximum area, the system comprising: 
4 a network; 

at least one computer connected to the network; and 
6 a scanner connected to the network, the scanner comprising: 

a motorized stage for mounting and moving the sample in a first manner 
8 . and a second manner, the first manner being movement of the sample in the 

sample plane at substantially constant velocity between a predetermined first 
1 0 position and a predetermined second position along a primary axis of travel 

defined by the first position and the second position, the second manner being 
1 2 movement of the sample along a secondary axis that is orthogonal to the primary 

axis of travel and in the sample plane; 
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14 an illumination system whereby at least one portion of the sample is 

illuminated; 

16 at least one microscope objective lens positioned along an optical axis 

centered about the portion of the sample illuminated by the illumination system 
1 8 and orthogonal to the sample plane; 

focusing optics whereby an optical signal from the microscope objective 
20 lens is focused onto an image plane that is orthogonal to the optical axis; 

at least one camera comprising a plurality of light-responsive elements 
22 disposed in at least one linear array, the light-responsive elements positioned in 

the image plane with respect to the motorized stage such that the camera has a 
24 linear field of view of a region of the sample on the motorized stage illuminated 

by the illumination system and orthogonal to the primary axis of travel; and 
26 a data processor for digitizing, processing, and storing light intensities 

from the plurality of light-responsive elements in synchrony with predetermined - 
28 sample motion, the sample motion being movement of the sample in the first 

manner to acquire a first strip image of the sample followed by movement of the 
30 sample in the second manner to position the camera for acquiring a second 

contiguous strip image, and repeating the sample motion as necessary so as to 
32 digitize the portion of sample for purposes of generating a complete image of the 

portion of the sample. ^ ^ 

36. The system as defined in claim 35, further comprising a local output 
2 device and at least one local input device each connected to the scanner. 
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37. A method of automatically digitizing with a scanner at least a portion of 
2 a microscope sample having a primary sample plane defined by a surface of the sample 

having the maximum area, the scanner comprising a linear array camera digitizing 
4 detector, the method comprising the steps of: 

^digitally scanning and storing a first image strip from a portion of the sample. 
6 while the sample is moving with respect to the linear array camera digitizing detector at 

substantially constant velocity; 
8 moving the sample so as to position the detector to a contiguous portion of the 

sample; 

1 0 digitally scanning and storing a second image strip from a contiguous portion of 

the sample, while the sample is moving with respect to the detector at substantially 
12 constant velocity; and 

repeating the steps of digitally scanning and storing contiguous image strips until 
14 the portion of the microscope sample has been completely digitized. 

38. The method as defined in claim 37, wherein the step of digitally scanning 
2 and storing a first image strip is performed in a first direction and the step of digitally 

scanning and storing a second image strip is performed in a second direction that is 
4 opposite to the first direction. 

39. The method as defined in claim 37, further comprising the step of 
2 assembling the plurality of contiguous image strips into a contiguous image. 

40. A method of automatically digitizing and reviewing with an optical 

2 microscopy system at least a portion of a microscope sample having a primary sample 
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plane defined by a surface of the sample having the maximum area, the optical 
4 microscopy system comprising a network, at least one computer connected to the 

network, and a scanner connected to the network, the scanner having a linear array 
6 camera digitizing detector, the method comprising the steps of: 

initializing the scanner; 
8 automatically digitizing an image of the portion of the microscope sample with 

the scanner through the steps of: 
10 digitally scanning and storing a first image strip from a portion of the 

sample, while the sample is moving with respect to the linear array camera 
12 digitizing detector at substantially constant velocity; 

moving the sample so as to position the detector to a contiguous portion 
14 of the sample; 

digitally scanning and storing a second image strip from a contiguous 
1 6 portion of the sample, while the sample is moving with respect to the detector at 

substantially constant velocity; and 
1 8 repeating the steps of digitally scanning and storing contiguous image 

strips until the portion of the microscope sample has been completely digitized; 
20 and 

reviewing the digitized image with the computer. 

41. The method as defined in claim 40, wherein the step of digitally scanning 
2 and storing a first image strip is performed in a first direction and the step of digitally 
scanning and storing a second image strip is performed in a second direction that is 
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4 opposite to the first direction. 

42. The method as defined in claim 40, further comprising the steps of: 

2 determining whether to return analysis to the sample based on the review of the 

digitized image; and 

4 upon a determination in favor of return analysis, determining whether the return 

analysis should be performed by a conventional microscope or the scanner. 

43. A computer image viewing frame for at least one complete image of a 
2 portion of a microscope sample comprising: 

a macro window where a macro image is displayed; 
4 an object window where at least one object image at low resolution is displayed; 

a zoom window where a zoom image or an object image at high resolution is 
6 displayed; and 

a user commands window where at least one control icon is displayed. 

44. The frame as defined in claim 43, further comprising an analysis window 
2 where at least one statistic is displayed. 

45. The frame as defined in claim 44, wherein any of a plurality of image 
2 attributes can be interactively selected as a basis for analysis. 

46. The frame as defined in claim 43, wherein any of the windows can be 
2 interactively sized and moved within the entire frame. 

47. The frame as defined in claim 43, further comprising a zoom region 

2 displayed in the macro window that corresponds to a zoom image displayed in the zoom 
window. 
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48. The frame as defined in claim 47, wherein the zoom region can be 
2 interactively sized and moved over the entire macro image. 

49. A method of generating a computer image viewing frame for at least one 
2 complete image of a portion of a microscope sample, the method comprising the steps 

of: 

4 displaying a macro image in a macro window; 

displaying at least one object image at low resolution in an object window; 

5 displaying a zoom image or an object image at high resolution in a zoom 
window; and 

8 displaying at least one control icon in a user commands window. 

50. The method as defined in claim 49,. further comprising the step of 
I displaying at least one statistic in an analysis window. 

51. The method as defined in claim 50, further comprising the step of 
I interactively selecting any of a plurality of image attributes as a basis for analysis. 

52. The method as defined in claim 49, further comprising the step of 
I interactively sizing and moving any of the windows within the entire frame. 

53. The method as defined in claim 49, further comprising the step of 
I displaying a zoom region in the macro window that corresponds to a zoom image 

displayed in the zoom window. 

54. The method as defined in claim 53, further comprising the step of 
I interactively sizing and moving the zoom region over the entire macro image. 
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55. A dynamic computer image viewing frame for at least one complete 
2 image of a portion of a microscope sample comprising: 

a macro window where a macro image is displayed; 
4 a movie window where a movie image is displayed; 

a zoom window' where a zoom image is displayed; and 
6 a user commands window where at least one control icon is displayed. 

56. The frame as defined in claim 55, further comprising an analysis window 
2 where at least one statistic is displayed. 

57. The frame as defined in claim 56, wherein any of a plurality of image 
2 attributes can be interactively selected as a basis for analysis. 

58. The frame as defined in claim 55, wherein any of the windows can be 
2 interactively sized and moved within the entire frame . 

59. The frame as defined in claim 55, further comprising a zoom region 

2 displayed in the macro window that corresponds to a zoom image displayed in the zoom 
window. 

60. The frame as defined in claim 59, wherein the zoom region can be 
2 interactively sized and moved over the entire macro image. 

6 1 . The frame as defined in claim 55, further comprising a scan tracker 

2 displayed in the macro window that corresponds to regions of the macro image that have 
been displayed in the movie window. 
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62. A method of generating a dynamic computer image viewing frame for at 
2 least one complete image of a portion of a microscope sample, the method comprising 

the steps of: 

4 displaying a macro image in a macro window; 

displaying a movie image in a movie window; 
6 displaying a zoom image in a zoom window; and 

i 

displaying at least one control icon in a user commands window. 

63. The method as defined in claim 62, further comprising the step of 
2 displaying at least one statistic in an analysis window. 

64. The method as defined in claim 63, further comprising the step of 
2 interactively selecting any of a plurality of image attributes as a basis for analysis. 

65. The method as defined in claim 62, further comprising the step of 
2 interactively sizing and moving any of the windows within the entire frame. 

66. The method as defined in claim 62, further comprising the step of 
2 displaying a zoom region in the macro window that corresponds to a zoom image 

displayed in the zoom window. 

67. The method as defined in claim 66, further comprising the step of 
2 interactively sizing and moving the zoom region over the entire macro image. 

68. The method as defined in claim 62, further comprising the step of 

2 displaying a scan tracker in the macro window that corresponds to regions of the macro 
image that have been displayed in the movie window. 
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69. A method of generating a dynamic computer movie image for at least 
2 one complete image of a portion of a microscope sample, the method comprising the 

steps of: 

4 dividing the complete image into a plurality of movie image strips; and 

displaying at least a portion of one of the plurality of movie image strips in a 
6 movie window in a manner that simulates a manual scanning motion of a conventional 
microscope. 

70. The method as defined in claim 69, further comprising the step of 

2 ranking portions of the movie image strips based on their image content and displaying 
those portions in rank order. 

7 1 . The method as defined in claim 70, wherein the portions of the movie 
2 image strips that rank of no importance are not displayed. 

72. The method as defined in claim 70, wherein the portions of the movie 
2 image strips that rank of lower importance are displayed at a first rate, the portions of 

the movie image strips that rank of higher importance are displayed at a second rate, and 
4 the first rate is faster than the second rate. 

73. The method as defined in claim 69, further comprising the step of 
2 evaluating elements of the movie image strips based on their image content and 

eliminating those elements that are not important to the user. 
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